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© General network modeling and synthesis. 

© A method and apparatus for modeling and synthesizing the response of a network to selected input signals 
where the input signals may be multi-channel in analog or digital form, and where the network's response may 
be linear or non-linear and depend on the present input signals as well as its past responses. A relationship is 
established between the input signals and the network's response to the input signals. Basis vectors are selected 
capable of representing the relationship. Weighting values for each basis vector are calculated. The calculated 
weighting values are applied to the corresponding basis vectors to form weighted basis vectors. The synthesis 
and modeling are then performed by forming a linear combination of the weighted basis vectors. Provision is 
made for feeding back the linear combination to account for memory and other history-dependent responses of 
the network. 
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GENERAL NETWORK MODELING AND SYNTHESIS 



BACKGROUND OF THE INVENTION 



Field of the Invention 

The present invention relates generally to the field of signal processing networks, and more particularly 
to a method and apparatus for modeling a network capable of processing analog and/or digital signals, with 
linear or non-linear response characteristics, capable of receiving multichannel inputs and outputs that may 
or may not be history dependent. 



Description of the Relevant Art 

Modeling and synthesis techniques involve determination of the relationship or relationships between 
selected inputs to a network and the desired or actual output of the network in response to those inputs. 
The techniques are fundamental to the arts of Computer Aided Design (CAD), Computer Aided Engineering 
(CAE), Test System Design, Simulation, Etc. 

As used herein, synthesis of a network involves deriving a mechanism (e.g.. one or more functions, 
values stored in a look-up table, etc.) which represents the network's response to certain inputs or ranges of 
inputs. Similarly, modeling a network involves utilizing the synthesized mechanism in a system in place of 
the actual network. 

Problems of modeling and synthesis of networks fait into several categories of complexity which limit 
the applicability of particular existing modeling and synthesis techniques. A network may operate on analog 
or digital signals, or both. The response of the network may be linear or non-linear. The present response 
may depend on one or more of the past inputs or responses of the network. The network may operate on 
one or more channels of input. Any and all of these network characteristics increase the complexity of the 
modeling and synthesis of the network and, consequently, reduce the number of available techniques for 
modeling and synthesis. 

There exist many methods of modeling and synthesizing linear networks, from linear regression to 
complex numerical modeling. The number of methods available is significantly reduced when the network's 
response is non-linear. There are three major methods traditionally used to model the input/output 
relationships of the non-linear network. The first is the quasi-linear methods of the Taylor Series Perturba- 
tion and Describing functions. The second is the differential equation method. The third is the integral 
equation or functional (or Wiener) method. Each of these methods is briefly described below. 

The Taylor Series Perturbation method involves establishing a dynamic operating point about which a 
Taylor Series is used to represent small signal deviations as perturbations, i.e., network response to an 
input. The disadvantages of the Taylor Series method involve the fact that the method depends upon the 
existence of derivatives of the response function (or "gain") to determine the functional response of the 
network. If such derivatives do not exist, the algorithm used fails to converge. This implies that only 
"smooth" non-linearities can be tolerated. An example of an application of this method is the SPICE 
computer program for use in circuit analysis. 

The describing function method involves producing a linearized model for each contribution to the 
output of the network. Sinusoidal describing functions, for example, form a linear network that represent an 
output as an undistorted sinusoid of the same frequency as the input signal and with a "gain" correspond- 
ing to the gain of the actual network at the excitation frequency. The method requires a new and possibly 
different model for each sinusoidal amplitude and frequency. 

A more general describing function can be constructed by using broadband excitation representative of 
the actual input signal and estimating the gain and phase shift for ail pertinent frequencies by means of the 
input/output cross-spectral density, Svx( ), and the input auto-spectral density, S*^). This results in a 
linear transfer function estimate, H(<*>), where 
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S vx (w) = lim E(lv T (w) X*(w)> 
V T («) X*(w) = | r v(t)e~ :, ^ t dt f x(t)e* j **dt 



where E{ ° } is the expected value. 

This yields a transfer function (gain and phase shift) at a given frequency based solely on the response. 
v(t), that is phase coherent with the excitation, x(t). The total output energy consists of the phase coherent 
20 signal and a residual output signal. n(t), that is uncorrelated with the excitation x(t). H(«>) represents the best 
(mean square error) linear estimate of a transfer function. 

The differential equation method involves the direct solution of non-linear differential equations. Because 
this method is very computation intensive, its implementation is mainly restricted to high-speed computer 
applications. Further, its results provide a response solution. v(t), only for a specific excitation signal, x(t). 
25 Finally, this method may also suffer from convergence problems similar to those mentioned above, 
depending on the program used for differential equation evaluation. 

The integral equation or functional method (developed by Norbert Wiener) involves consideration of not 
only the instantaneous non-linear distortions of present input values, but also non-linear interactions, over 
' time, of past and present data. This is a characteristic of the general network problem involving memory (or 
30 history dependence). 

The functional method represents memory with an infinite set of orthogonal filters such as a bank of 
filters having the different order Laguerre functions as their impulse responses. The complete set of filter 
outputs, {u } (t)}, at a given point in time constitute, in some sense, a complete history of the excitation 
signal. x(t). Specifically, 



U i (t) = f *MOx(t-T)dT 

J o 

From which a general non-linear function may be constructed using the following multinomial power series 
:t)= *o + 1 a li u i (t)+ J a 2iJ u 1 (t)u J (t) + ... 



V(1 



i=o 



+ I a nijV t)u j (t > ••• + 



Substituting the expression for u { (t) yields v(t) in the form of a Volterra equation of the first kind 



S5 



3 



EP 0 373 737 A2 



v't) 




T-)x(t - T 9 )--x(t - T )dT 1 dT,---dT 
A * n 1 2 n 



+ . . . 



where 



k n (T l' T 2'- T n ) m I 



a nij... h i (T l )h j( T 2> *•• 



i.J 



» • 



M * ) is the nth order impulse response of the network, an n-dimensional impulse response function that 
has a corresponding n-dimensional Fourier transform 

MTi J2.—T„) ~> K n (an ,«2,...« n ) 

which represents the broadband or multifrequency response of the network to all combinations of 
frequencies taken n at a time. The resulting transfer function K n ( • ) gives the gain and the phases at each 
of the interacting frequencies. 

Although the functional method is comprehensive, its applications have been limited to modeling mildly 
non-linear networks requiring the determination of a small set of low order terms, for example as operational 
amplifier networks with small third order distortion. In the case of severe or non-integer-power non- 
linearities, the power series expansion is grossly inefficient because of the large number of terms required. 

To compound the complexities and inadequacies of the above-mentioned methods, the general network 
solution must not be limited by any distinctions between analog and digital signals, especially when the 
inputs may be in mixed analog and digital form. These networks, representing the interface between the 
digital computer domain and the "natural" analog world, are characterized by "hard* non-linearities such as 
thresholding elements in analog to digital converters. Also, the logic networks are grossly non-linear, so that 
the combination of both types in a single network present formidable modeling problems. None of the 
above-mentioned methods have been able to adequately deal with the mixed analog and digital signal 
cases. 

Finally, a realistic model of a network must be able to represent the case of multichannel inputs. For 
example, when modeling the response of a semiconductor element, time-varying values such as current 
density, temperature, electric field, etc., all contribute to the response characteristics of the device. Proper 
consideration of multichannel inputs increases the number of possible bit interactions exponentially, and 
correspondingly increases the complexity of the synthesis and resulting model. 

There is a present need in the art for a method and system for modeling and synthesis of networks of 
mixed analog and/or digital signals having linear or non-linear responses which may receive a plurality of 
input channels and whose inputs may be memory dependent, which overcome the limitations and 
disadvantages of the prior art. The present invention provides such a method and system, as further 
described in detail below. 



The present invention is directed to a method and system for modeling and synthesizing a logic 
network or a network of analog, digital or mixed analog and digital signals having a linear or non-linear 
response to past and present values of a plurality of input channels. Such a network is generically referred 
to as a "General Network." Hence, the present invention provides a method and system for modeling and 
synthesizing a General Network. 

Modeling and synthesizing of the General Network in the present invention is based on digital or 
quantized analog multichannel inputs, and either analog or digital outputs. Such quantized analog input 
signals may be acquired from analog inputs via a continuous analog-to-digital converter (quantizer), 
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sampling analog-to-digital converter, or other quantizing means. 

The model itself is based on a specified relationship between the inputs and outputs of the network. 
This input/output relationship may be defined by a reference model whose behavior the network emulates. 
Since the precise nature of the functional relationship between inputs and outputs may not be known for the 
5 network, the reference model may be used as a means for synthesizing the General Networks behavior. 

The present invention proposes a modeling system including 
means for generating a plurality of vector elements each representative of a unique combination of said 
inputs; 

means for applying to each element a predetermined weighting coefficient, and; 

70 means for combining said weighted elements in a linear manner; 

said weighting coefficients being selected such that said combination yields the expected or desired output 
of said reference network in response to said inputs. 

A network to be synthesized is modelled either as a feedforward or feedback network. An appropriate 
basis set of functions is selected, which set consists of basis vectors capable of representing the 

75 corresponding specified input/output relationship. There are many groups of functions which, when properly 
combined, are capable of synthesizing virtually any function. As a general rule, these groups form complete 
orthogonal sets, such as the Legendre polynomials, the Walsh functions, etc. Since the present invention 
operates on binary signals, the binary Walsh functions are quite well suited to the method of the present 
invention, and are utilized in the preferred embodiment described below. 

20 Associated with each vector of the basis set of functions are real-valued weighting coefficients. The 
values of the weighting coefficients are determined from the relationship between the inputs and the outputs 
of the network. In the preferred embodiment, a Walsh Exclusive-Or decoder generates all possible unique 
combinations of the input bits, so as to represent both linear and non-linear elements of the network's 
response. The Walsh Exclusive-Or decoder is a preprogrammed series of Exclusive-Or gates which are 

25 capable of producing all possible interactions of the input bits. The interactions formed at the output of the 
Walsh Exclusive-Or decoder are Walsh functions, each unique input bit pattern producing a Walsh function 
of corresponding order. The appropriate weighting value for each combination of bits is determined by a 
Fast Walsh Transform. 

A linear combination of the weighting coefficients is formed for each basis (Walsh) vector, and the set 
30 of resulting weighted basis vectors forms the General Network model. The array of weighting values 
determined for each of the basis vectors may be stored in a look-up table, or other memory device, for 
recall in response to appropriate inputs in order to avoid repetitious calculations. 

The present invention will be more readily understood from the following detailed description of the 
preferred embodiment The detailed description is to be taken in conjunction with the accompanying 
35 drawings described briefly below. 

It will be appreciated that where the reference network is an abstract target network which is functionally 
specified, the modeling cell represents a network synthesized to achieve the target specification. Thus, 
networks may be synthesized on the basis of design functional specifications, for example in a computer 
aided engineering system. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 



45 Fig. 1 shows the input-output relationship of an arbitrary network; 

Fig. 2 shows an example of the domain of a network's response to a quantized analog input signal; 

Figs. 3a, b and c show examples of Walsh matrices, W N , whose rows and columns are Walsh 
functions of rank N = 2, 4 and 8, respectively; 

Fig. 4 shows the basic structure for the General Network modeling of the network shown in Fig. 1 ; 
so Figs. 5a, b and c show the signal flow for a Fast Walsh transform for N = 2, 4 and 8, respectively; 

Fig. 6 shows a schematic diagram of a General Network model with q = 3 elements of the b-vector; 

Fig. 7 shows a schematic diagram of a full-wave diode rectifier; 

Figs. 8a and b show the transfer characteristics of the full-wave rectifier shown in Fig. 7, in standard 
and normalized forms, respectively; 
55 Fig. 9 shows the General Network model for the full-wave rectifier shown in Fig. 7; 

Fig. 10 shows a Negate Logic apparatus used to generate th output of a WEX network; 

Figs. 11a and b show the input and response sequence, respectively, of a filter used to demonstrate 
th mod ling and synthesis of a General Network; 
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Figs. 12a and b show the General Network models for the filter having the input and response 
sequences shown in Figs. 11a and b t for 6 = 0 and $ = 2,-2, respectively; 

Fig. 13 shows a model of a network having memory, feedback and feedforward elements; 
Fig. 14 shows the structure for the General Network modeling of the network shown in Fig. 13; 
s Fig. 15 shows a device for determining the y vector during a data acquisition procedure; 

Fig. 16 shows the schematic diagram for a feedback shift register; 

Fig. 17 shows a General Network model of the feedback shift register shown in Fig. 16; and 
Fig. 18 shows a General Network for converting a floating point number into a signed integer number 
in binary format. 

10 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 



Fig. 1 shows a model of a system with a functional relationship between input and output signals 

15 defined as v(t) = f{x(t)}. The input signals, x(t). may be in digital form, analog form or a combination of the 
two. Further, the input signals may be a field or fields of time varying bits. The nature of the input signals 
will be determined by the specific application of the present invention. Likewise, the output signals, v(t), 
may be digital or analog, depending on the specific application of the present invention. Since it is clear 
from the above that both the input signals, x(t), and the output signals. v(t), are functions of the variable t, 

20 for clarity the notation x as input signals and v as output signals will be used herein. 

The functional relationship, f{x} may be linear or non-linear. It will be assumed throughout this 
description that f{x} is non-linear, since modeling and synthesis solutions for f{x} as a linear function are 
well developed in the art and are a degenerate case of the general non-linear response. Although it is likely 
that the precise functional relationship, f{x} f is not or cannot be known, it will also be assumed throughout 

25 this description that the set of ordered pairs [xj, Vj] f * where Xf is a particular input signal, and v$ is the 
* corresponding network response, is given for a sufficient range or variety, i.e., the actual or desired output 
signals for given input signals are known. The criteria for determining the sufficient range is that the number 
of ordered pairs must be at least equal to the degrees of freedom of the network (the latter point is 
discussed in greater detail below). 

30 It is known that weighted sums of Walsh functions are well suited to the* representation of arbitrary 
functions (see Corrington, ADVANCED ANALYTICAL AND SIGNAL PROCESSING TECHNIQUES, ASTIA 
doc. no. AD277942, 1962, which document is incorporated by reference herein). Consider the expansion of 
f{x} on the domain X, x e X (that is, x being an element of X), in terms of the Walsh functions. For any 
domain X consisting of a binary number of states, N = 2 q , there exists a complete set of N orthogonal 

35 Walsh functions { k (x)} of corresponding binary rank, N, so that 

N-l 

f{X} = N IV^)' 



40 



k being the order of the Walsh function k (x). 

To allow an ordered processing of x, and limit the dimensions of the modeling problem, any analog 

45 components of x are quantized, i.e., digitized. This quantization may be accomplished, for example, by 
applying the input signals to a continuous or discrete time sampling analog-to-digital converter. (For a 
discussion of continuous analog-to-digital conversion, see application for United States Letters Patent, serial 
no. , filed December , 1988 , which is expressly incorporated by reference herein.) It should be noted 
that although the analog input signals are quantized (digitized) in the present invention, the analog input 

50 signals may be asynchronous and need not be sampled, i.e., the establishing of digital values for the analog 
input signals may be asynchronous and need not be periodic or tied to a particular clock cycle. The 
* resulting quantized signal would comprise q binary bits, and the domain of the response of the system, 
f{x}, would lie on the interval of ^ = 2* segments between x Q and x 0 + N-1, as illustrated in Fig. 2. The 
quantized analog components of x, together with any digital components of x, are symbolically represented 

55 hereafter as a vector of bits, b (again, it is understood that b may be a time-varying function, i.e., b(t)). 

The quantizing (digitizing) of the analog input signals does not affect the relationship between the input 
and output signals (or affect the ordered pairs [x lt v,]). This stems from the fact that a quantized signal 
(which is not limited by a sampling period) does not suffer from aliasing error (it may, however, suffer from 
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quantization error). Thus, the relationship between x and b is an equivalence relationship, 
x — (b q b q ., • • * bi ) T = b 

where the superscript T represents the transpose of the associated vector. 
In terms of the quantized variable b, this equivalence implies 



N-l 

f {b} = N I "kV b > 
k=o 



where 



N-l 
b=o 



20 and hence relates the non-linear operation f{x} t to the quantized input b-vector. 

Of the last two expressions, the latter represents the Walsh transform of f{b}, while the former 
represents the inverse Walsh transform of f{b}. (The Walsh transform and inverse transform are analogous 
to the Fourier transform and inverse transform.) Thus, the relationship between input and output signats of 
the network may be functionally represented by a weighted sum of Walsh functions, the weights determined 

25 from the ordered pair [x j( V|]. 

Examples of sampled Walsh matrices, W Nl of rank N = 2, 4 and 8 (q = 1,2 and 3) whose rows and 
columns are sampled Walsh functions are shown in Figs. 3 a, b and c, respectively. (In Figs. 3 a, b and c, a 
" + " indicates a value of +1 and a indicates a value of -1 as between the matrices and the 
corresponding Walsh functions). Each column (and row, due to diagonal symmetry) of the Walsh matriees 

30 represents the values of the kth order Walsh function, i£ k (x), OSklN-1, for that rank-N Walsh matrix (i.e., 
i£ k (x) takes on values of +1 and -1 only). The diagonal symmetry of the Walsh matrices imply that, in 
general, 

« *i(i) 
so that 



N-l 

f(b) ■ h 1 <W*> 

k=0 



and 



N-l 



*k = 



J f{b>* k (b) 



b=0 



50 The domain of k determines the order of Walsh function, N, that enters into the inner product 
f{b> = & « T * b (k) 
where 

ar T = (croon * * * a N .,) 

and i£b( k) are Nx1 vectors. 

55 Implementation of the method suggested by the above representation of f{x} first involves a determina- 
tion of the values of thea k from the ordered pairs [xi, vj. The values for a k , 0 Z k £ N-1 , may be obtained 
from the expression 
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N-l 
b=0 

5 

or in vector notation, 

a = W N f{b} 

which is the standard form for the Walsh transform of f{b}. It is noted that the values obtained fora k may be 
10 in either digital or analog form depending on the particular application. Furthermore, values ofa k obtained in 
one form (e.g., digital) may readily be substituted for those in another form (e.g., analog) by means well 
known in the art. 

A numerical method for evaluation of this last expression given the ordered pairs [X|, vj] is the Fast 
Walsh Transform (FWT), which is analogous to the Fast Fourier Transform (FFT), The FWT has the same 
;5 signal flow pattern as the FFT with the exception that all complex "twiddle" factors are replaced by either 
+ 1 or -1 so that multiply-add operations become simple add or subtract operations. The basic transforma- 
tion is the product 
Y = W N *y 

where y is the N X 1 vector to be transformed. The inverse transform is the same form, 

except for the scale factor 1/N. The signal flow for the transformation is shown in Figs. 5 a, b and c for N = 
2, 4 and 8, respectively The extension to larger Ns is implicitly clear. When two points are combined to the 
right, the right one is subtracted from the left one, and when combined to the left, the two points are added. 
Note that the indices of the transformed data are in bit reversed order, as in the case of many FFT 
25 algorithms, e.g., Yioo is interchanged with Y 0 oi, etc. See Yuen, WALSH FUNCTIONS AND GRAY CODE, 
from "Applications of Walsh Functions," 1971 proceedings, edited by R.W. Zeek and A.E. Showalter, and 
references cited therein, which is incorporated by reference herein. 

The FWT obtains in Nlog 2 N add-subtract operations the coefficients for the a k vector. Having obtained 
the a k vector, f{b} may then be acquired from 

30 

N-l 

ffb > = N 1 "kV k > 



Implementation of this expression for f{x} suggests the structure shown in Fig. 4. It is assumed that the 
a k vector has been determined. The input signal, x, is first applied to quantizer 10, which quantizes the 
input signal into q bits, b q b q . t ... bi, i.e., the b-vector. The b-vector is then applied to WEX network 12 
40 (described in detail below) which produces at its N outputs the ^ b (k) vector. The ^ b (k) vector is then applied 
to a k weighting network 14. It should be noted that since the iA b (k) vector only takes on values of +1 or -1, 
add-subtract operations replace the multiplications implied by the weighting process, which significantly 
simplifies implementation of the method. a k weighting network 14 forms at its output the set of scalar 
products 

45 {or k «> * k (b)}; k =0, 1, ••• N-1 

A linear combination of the scalar products is then formed, for example, by summing junction 16 to form 
{(b) = A « T *<b) 

The nature of WEX network 12 follows from the nature of the Walsh functions. Each set of binary rank 

Walsh functions constitute a group that is closed under multiplication, i.e., 
so MD'+hfl) = *i©kG) = *i< iek ) 

where iek represents the bit-by-bit modulo-2 addition of the binary bit representation of i and k. For 

example, if i = 0101 and k = 1100, i©k = 1001. (Note that *,(]> ^(j) = <Mj) = + 1. As will be shown, the 

function of the WEX network 12 corresponds to the bit-by-bit exclusive-or (EOR) operation on i and k. 

Hence the designation Walsh Exclusive Or (WEX) network. 
55 Closure implies that any Walsh function of arbitrary order within a group of rank N Walsh functions may 

be generated exclusively from the binary order Walsh functions, and more specifically from the bit pattern 

of b, the input b-vector, where 

b = (b q b q ., — bi).b, = 

8 
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describes the state of the <p b (k) vector at k = 1, 2, 4 2* 1 as follows 

0 b (2 j ) = b,.,. i = 0. 1. 2 q-1 

From this knowledge, and recognizing that 



q q-1 



bi <k). 



b = 



Vq-i 



70 



* b (*> - * b oo...o< k >-*ob a ,o ... o< k) ... *o...ob 1 (k) 



75 



or equivalently 



20 



V k > = %q-l (k) 



2 q 2 



b, b 1 
2 1 2° 



25 



because 



30 



♦Vi«„.ii • " p * 1 :° 

2 p - 1%p p+i = 1 



35 



40 



For example, if x = 13, then 
13 ~ 1 101 = [b4b 3 b 2 bi] 
and 

^is(k) = ^noi(k) = ^ioao(k) • ^oioo(k) * tfoooi(k) 
also 

#n(k) = *2 3(k) • 2 <k) • & i(k) -^o(k) 

Further, at k = 2 kqp , the binary order columns of W N are the binary order Walsh functions, 0 2p (k)}, 
which assume values in accordance with 



45 



* 2 P Ck) = *°--- ob p+ i 0 0(k) = (-D k q-P 



evaluated at k - 0 ... Ob, 0 ... 0, that is 

q-p 



50 



* 2 P Ck) = *o- -ob p+1 o ... 0(k) 



k = 0 . . . Ob 0 . . . 0 
q-p 



= (-1) q-p 
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"hus , 



k q b l ^-1^2 
* b (k) = (-1) q (-1) q 12 ... (.i, 1 <3 

or 

* b (k) = (-l) k <3 b l f k <3"l b 2 • ... t k lbq 

For example, the fifteenth entry of the seventh row of W, 6 (the 16th order Walsh matrix) would be 
<Mk) = *oiu(k) = (-1) 1 k * e 1 k 3 o i«k 2 eO-k, 
b = [0111] — 7 
k = [k*k 3 k 2 k,] = [1111] — 15 
so that 

-M15) = (-1) 1 ® 1 •'•0.. 1 

Thus, we may conclude that the essential function of WEX network 12 is to perform a set of EOR 
operations on the input b-vector. In fact, the function of WEX network 12 is actually to form all possible 
combmations of the bits of the input. The WEX network 12 may include distinct structures for accomplishing 
each function. "Combinations" as used herein refers to permutations of groupings of the elements of the b- 
vector without regard to order. 

With regard to notation, the standard symbology is used for the EOR operation. The truth tables for an 
EOR operation on 2 and 3 inputs is shown in Tables 1 and 2, respectively. Construction for larger numbers 
of inputs follows intuitively. 



Table 1 



inputs 


output 


A 


8 


X 


0 


0 


0 


0 


1 


1 


1 


0 


1 


1 


1 


0 



(e.g., Signetics 
7486) 
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Table 2 



inputs 


output 


A 


B 


C 


X 


U 


0 


0 


0 


0 


0 


1 


1 


0 


1 


0 


1 


0 


1 


1 


0 


1 


0 


0 


1 


1 


0 


1 


0 


1 


1 


0 


0 


1 


1 


1 


1 


(e.g 


Signetics 74S135) 



20 



25 



As an example, consider Fig. 6 t which is a schematic diagram of a Genera! Network model, generally 
designated by reference numeral 18, of a network with q=3 elements of the b-vector. The b-vector 
comprises bits b 3 b 2 bi (bt being the LSB), so that three bit lines 22 lead into WEX network 20. The b-vector 
is applied to WEX network 20, which consists of a plurality of EOR gates 24. The maximum number of EOR 
gates that would be required is 2 q -1 =2 3 -1 = 7, however, that number may be reduced as described in detail 
below. The outputs of the EOR gates correspond to the Walsh functions of order b, i.e.. b (k)- WEX network 
20 is thus capable of forming the input bit pattern as well as all possible interactions between the bits 
comprising the b-vector. 

A number of the EOR gates 24 are connected to only a single bit line 22. The unconnected inputs to 
each of these EOR gate 24 are allowed to float low, so that the EOR gate is asserted when the connected 
bit line is high, as if its associated weight 28 were directly connected to the bit line 22. 

The output of the EOR gates 24 (i.e., the output of WEX network 20) forms the ^ (k) vector, the « (k) 
vector is applied to the a k weighting network 26. The a k weighting network consists of a number of memory 
elements 28, each element corresponding to an element of the a k vector. The maximum number of memory 
elements that would be required would be 2 q « 2 3 = 8, however, that number may be reduced as 
described in detail below. The value stored in each of memory elements 28 are summed by summing 
device 30 to form the scalar output, v, of the General Network model 18. When an EOR gate 24 is asserted 
(i.e., when it outputs a "true" value) the corresponding a k weighting network element is negated so that the 
negative of the stored value is formed in the sum. 

Alternatively, when an EOR gate 24 is asserted, the corresponding a k weighting network element may 
be added into the sum. Only those a k weighting network elements corresponding to asserted EOR gates 
contribute to the sum. This follows from the fact that the output of EOR gate 24 will generally be either "0" 
40 or "1". Assuming the convention that a " + "corresponds to "0" and a "-" corresponds to "1", from the 
Walsh matrices, the sum may be calculated from: 



30 



35 



45 



N-1 N-1 N-1 

J * b (k,a k = 2 J l/2l* b (k) ♦ * b (0))a k - J a 
k=0 k=0 k=0 



k 



so Of course, it is a straight-forward modification of this approach to form the sum of those a k weighting 
.network elements corresponding to non-asserted EOR gates. The method chosen will depend on the 
particular application. 

Consider, by way of example, the full-wave rectifier shown in Fig. 7, having the transfer characteristics 
shown in Fig. 8a. The range of values indicated includes 16 data points for -8 = x = 7. Thus, a 4-bit b- 
55 vector is selected. If two's complement code is used to represent the data from Fig. 8a. we arrive at the 
values shown in Table 3. 
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Table 3 
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20 The row labelled "State b" is a positive integer ranging over N = 16 values, 0 to 15, corresponding to 
the unipolar binary code interpretation of the input code. This transformation to "State b" is a convenience 
which normalizes the range of the input so that its domain spans from 0 to N-1. This causes f{x} to be 
remapped as 7{b} as shown in Fig. 8b. 

The values for a k , 0 £ k £ N-1 , may be obtained from the standard expression for the Walsh transform 

25 of f{b} discussed above, namely, 

N-1 
b«0 



An FWT performed on f{b} yields the values for <* k as a function of k shown in Table 4. 
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Table 4 



This provides all of the necessary information needed to synthesize the General Network equivalent to 
45 the full wave rectifier. The resulting General Network model for the full wave rectifier is shown in Fig. 9, 
where the output, f{b}» is, in vector notation 
f{b} = ^ W N a 

Analogous to Fig. 6, the General Network model includes WEX network 32. Since the Walsh transform of 
f{b} resulted in a value of 0 for several of the * b (k), there is no need to include an EOR gate in WEX 

5Q network 32 for the corresponding t£ b <k). This results in a total of four EOR gates 34 for the General Network 
model. Likewise, the General Network model includes a k weighting network 36, which holds the non-zero o k 
values in memory elements 38. The value stored in each of memory elements 38 are summed by summing 
device 40 to form th scalar output, v, of th General Network model, with the content of a memory element 
38 negated when the'b input results in an asserted corresponding EOR gate 34. 

55 The fact that the Gen ral Network model is accurate for the given inputs can be verified from Table 5. 
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Table 5 
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25 It should be noted that the net result of the WEX network is to generate one or more sets of negate 

instructions. Each set of negate instructions corresponds to a Walsh function. 

The method described above involves utilization of a preprogrammed series of EOR gates which are 

capable of producing aii possible interactions of the input bits. The sets of negate instructions can quickly. 

be determined from reference to a Walsh matrix like those shown in Figs. 3a, b and c. For example, to 
30 determine the output state of the WEX for tfs(7), reference can be made to the Walsh matrix shown in Fig. 

3c. From this, it is determined that the value for ^(7) »s ,, + ", or 0 (remembering that the output of the 
• WEX is in binary form, and adopting the convention that a n + rt represents a logic 0 state and a 

represents a logic 1 state). Thus, the hard-wired WEX network may be replaced by a Walsh matrix of 

appropriate rank, stored in a look-up table or the like. 
35 Alternatively, the calculations of <Mk) may be done sequentially. The Negate Logic apparatus 42 shown 

in Fig. 10 allows generation of the outputs of a WEX network without requiring the preprogramming of the 

EOR gates. The Negate Logic apparatus 42 shown in Fig. 10 is for N = 2 q = 2 3 = 8 (i.e., q = 3). The 

Negate Logic apparatus 42 consists of a plurality of AND gates 44 and EOR gates 46 connected in a 

reducing network, with the b and k values as inputs. In order to determine the value of 0 b (k) for a particular 
40 b and k value, the binary value of b is applied to AND gates 44. Likewise, the binary value of k is applied to 

the AND gates 44, but in reversed order to that of b. The resulting output, NEGATE a k , will represent the 

output of the corresponding EOR gate from the WEX network. 
Thus far, the problem of synthesizing a non-linear function 

v(t) = f{x(t)> 

45 has been approached in a manner that implies a no-memory operation on a single channel signal, x(t). In 
fact, in the most general case, the no-memory, single channel limitation is inappropriate since a properly 
defined x(t) may be generalized to include such features as: 

1 . Input history (memory) dependency; 

2. Feedback dependency; and 
so 3. Multi-channel inputs. 

The output of many, if not most, practical networks exhibit a dependency on present and past input 
values due to either reactive (capacitive. inductive, etc.) analog elements or explicit memory elements 
imbedded in the structure. Linear as well as non-linear interactions may occur between prior and present 
input values. Feedback dep ndency may also occur, often creating memory dependencies on the infinite 
55 past of input and output states. Also, multiple inputs often include not only th primary signal(s) but also 
environmental effects and control signals. By appropriately defining the General 

Network model, the most general features of the network may be synthesized and modelled. 

Again, let b(t) represent the quantized values of the input vector, x(t). If the input time-varying bit pattern 
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is defined to be a field of time-varying bits. b(t), composed of words, {b(t,i)} ( so that 

b(t) = [b(t,l)b(t,2) ... b(t.m)] 

where 

b(t,i) = [bufObud) ... b qj (t)] 
and 

b ki = {i 

then b(t) is a composite "number" containing all of the essential input data. In other words, if the composite 
input, b(t). is applied to a WEX network, replicas of the original bit pattern as well as "bits" corresponding to 
all of the non-linear interactions of these data bits will be produced. 

The number of possible output taps, N, from the WEX network determines the complexity of the model. 
N increases exponentially with the number of bits in the field of b(t). That is, 
N = 2 Z i Q i 

This complexity is a consequence of the generality of the model and follows from the composite nature of 
the input, b(t). 

Fig. 13 shows a generalized model of a network having a specified relationship between input signals 
and output signals which includes feedback and feedforward, and which may include non-linear responses 
to multi-channel inputs. The relationship between input and output for this model is defined as 
v(t) = f{x(t), g{x(t).w(t)}} 

As before, the input signals may be digital, analog or a combination of digital and analog, depending on 
the specific application of the present invention. Likewise, the output signals. v(t). may be digital or analog 
as needed. (The convention of referring to x(t) as x, b(t) as b and v(t) as v will be repeated here, as above). 

Implementation of this expression for f{ • } suggests the structure shown in Fig. 14. The underpinnings 
of the structure are similar to that shown in Fig. 4. That is, present in this General Network model is WEX 
network 48, a k weighting network 50 and summing junction 52. However, because of the requirement that 
the model be capable of representing feedback and feedforward inputs, a second weighting network, & k 
weighting network 54 has been added along with a corresponding summing junction 56. The input signal, x- 
(t) is applied to a quantizer 58 to produce quantized signals which, via tapped delay lines 62, may be 
applied to WEX network 48 whose output is the N values of the tf b (k) vector. 

The output of WEX network 48 may be fed back to its inputs so that its inputs may consist of a 
combination of x(t). all or parts of its own output, and delayed replicas of each. Tapped off of the N outputs 
of WEX network 48 are bit-lines 60 which apply the output signals from WEX network 48 to the 0 k 
weighting network. The weighting of the output signals of WEX network 48 is accomplished by add-subtract 
operations, due to the + T/-1 nature of its output. The 0 k weighting network forms at its output the scalar 
product 

A linear combination of the scalar products is then formed by, for example, summing junction 56. The linear 
combination is then input to WEX network 48 as the feedback portion of its input 

The N outputs of WEX network 48 on bit-lines 60 are also applied to the « k weighting network 50. 
Again, the weighting of the output of WEX network 48 is accomplished by add-subtract operations as 
discussed above. The a k weighting network forms at its output the scalar product 
r <*k^b(k) 

A linear combination of the scalar products is then formed by, for example, summing junction 52, to form 

In general, the precise nature of f{ • } may not be known explicitly. However, a reference model may 
be used to observe the input/output behavior as a means of synthesizing a General Network model with the 
behavior of f{ • }. 

If v is the reference model output and b corresponds to its total input (again, b is the quantized bit 
vector of the WEX input), the design or synthesis process requires estimating the vector a corresponding to 
an approximated output v so that the General Network output, v, minimizes some error criterion such as the 
mean square error 



ej(t) * tv(t) - v(.t)] 2 



where the over-bar represents time averaging. 
The solution for a is 
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« = I*b(t)"*b<t) rl * l *b(t) V < t)1 

The weighting vector, a, is the product of the inverse covariance matrix of the WEX output vector, ^b(t>(k), 
and the time averaged cross-correlation vector of the output vector ^ b(t ) and the desired scalar output, v(t). 
In the feedback case, the weighting vector, 0 , must satisfy a similar condition: 



6 - f *b(t)-*b(t ) J ' 1 • f *b ( t) w < t > 1 



where 



*£<t) = (w(t) - w(t)] 2 



where w(t) is the component of b(t) corresponding to the feedback signals. Alternatively, g{ • } may be 
synthesized by a separate General Network model with x(t) and w(t) as the inputs and w(t) as the output. 
If an exact complete behavioral model is required, two conditions must be met: 

1. The degrees of freedom (DOF) of the General Network must equal or exceed the DOF of the 
reference model: and 

2. Sufficient variety is required in b(t) to ensure the excitation of all states of the reference model. 
DOF in bft units is measured by the number of bits required at the input to the WEX provided that the 

requisite variables and delays are adequately represented in the vector, b. For example, consider the full- 
wave rectifier shown in Fig. 7 and described above. The system has four inputs, .each with a binary state, 
resulting in 16 DOF. If sufficient DOF are not included in the model, more than one value of output may 
occur for a given input vector b. Averaging these values will result in a best (least mean square error) 
reduced DOF model of the network. 

For a narrowly defined model, i.e., one that has a specified behavior for a limited variety of input 
signals, a simpler model of lower DOF may result. For example, should it be desired to synthesize the 
network behavior of an amplifier which only operates below saturation, and hence the General Network 
model be valid only below saturation, there is no need to have response values for the amplifier above 
saturation. This would result in a fewer number of possible inputs and, hence, fewer DOF. Although the 
resulting model may not characterize the amplifier network for al! input levels (the model would not be 
accurate at or above saturation), it may nonetheless be accurate for inputs below saturation. 

If a network is "noisy" the network may have more than a single output for each input. When such is 
the case, an "averaged" output vector may be produced from the observed outputs to model the system, 
i.e., a time-average of the outputs is used to minimize the mean square error 

tj(t) = (v(t) - v(t)J 2 

50 

and 



*J(t) = (w(t) - w(t)] 2 



20 



30 . 



35 



40 



15 



EP 0 373 737 A2 



If the input and output data are sampled, a "fast" (highly efficient) algorithm may be used to extract the 
a and 0 weighting vectors that takes the form: 



a » W N - 7 
where 

7 = lA-'WW b(n) ] • v(n) 
A = Diag[\ 0 \i ••• \ n .,] 

and X is the ith eigenvalue of 



T 

*b<n)'*b(n) 



corresponding to the ith eigenvector <fc and it is equal to the value of the output each time that *i occurs. 
Note that this expression for a is of the same form as that previously derived for the simple one variable no 
memory non-linearity, namely 
a = W N f 

where f is the representation of the non-linearity as a function of b (f = f{b» 
f{b} = A W N « 

From which we conclude that 
7(b) = f{b} 

where f{b} has been generalized to include the no-memory, single-variable as a special degenerate case. 
The N x 1 vector, 7 , may be formed, in the case of a deterministic (noiseless) system, by ordering the 
value of the output, v(t), as a function of b. In other words, 
7 = f{b},b = 0,1.2 N-1 

For each input code, b, one and only one value of v results so that 
v(b) = f{b} = y 

This operation may be done "on the fly" as a data acquisition procedure without any substantial penalty in 
processing time. 

For example, Fig. 15 shows a device capable of producing the intermediate vector, 7 , as part of a data 
acquisition procedure. Input signal x is applied to the reference model 80, whose output v is in turn applied 
to y processor 82. Simultaneously, input signal x is applied to tapped delay line 84 so that input signal x 
may be synchronously applied to y processor 82 with the output v of reference model 80. Likewise, the 
output v of reference model 80 is applied to a tapped delay, line 86 so that it too may be synchronously 
applied to y processor 82, in the form of feedback. The inputs to y processor 82 are thus the b vector and 
the reference model response v. From these inputs, y processor 82 produces the intermediate vector, 7 . 

The final operation is an inverse Walsh transform IWT 90, that forms a or 0 from W N and and which 
takes approximately Nlog 2 N add/subtract operations. Hence, synthesis requires a modest amount of 
processing, proportional to Nlog 2 N simple operations. 

It should be noted that in circumstances where there are multiple input channels, a number of parallel a 
and/or 0 vectors , may be required. Calculation of these parallel a and/or 0 vectors is as previously 
discussed, and the hardware is unchanged apart from the added storage space required by the additional 
coefficients. 

Occasionally it will occur that the intermediate vector will contain one or more undetermined coeffi- 
cients. This results from having a smaller number of possible excitation states of the Network than degrees 
of freedom of that network allows. When this happens, the undetermined coefficients can take on any value 
selected, and may be used to minimize or maximize certain aspects of the resulting General Network 
model. An example demonstrates this. 

It is desired to synthesize a filter given the periodic input sequence, x(n), and the response sequence, 
v(n), as shown in Figs. 11 a and b, respectively. The input is a sampled "square" wave while the output is a 
sampled sinusoid corresponding to 
v(n) = sin(n + i)^ 

A f edforward model with two delay elements, T. is selected. The minimum b-vector t formed such that 
■ r +" > corresponds to "0" and corresponds to "1 
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10 The corresponding values of v(n) are 

v(n) = [.5 1 -5 -.5 -1 -.5] = .5[1 2 1-1-2-1] 

The intermediate coefficient vector, y , is constructed by re-ordering v(n) in ascending order of the values of 
b 

b = [0 1 2 345 6 7] 

75 7 = .5[1 2 0 1-10-2 -1] 

where 0. implies* an undetermined coefficient (resulting from the requirement of two input delays so that x(n), 
x(n-1) and x(n-2) constitute a three bit b-vector implying N = 2 3 = 8 degrees of freedom, but only 6 unique 
output constraints exist (.5, 1, .5, -.5, -1, -.5)). This implies a large set of solutions of which two are shown, 
one in Fig. 12a for 0=0, and one in Fig. 12b for 0 = 2, -2. 

20 For = 0, we solve for 

A « = A W NT 
to obtain 

% a = HO 2 1 0 -1 0 0 0] T 

The resulting General Network model is shown in Fig. 12a. It is noted that this results in a total of three 
25 connections of the bit lines to three two-input EOR gates. Further, three a k weighting values must be stored. 
For 0 = 2, -2, we solve for 

r a = fj W N -y 

to obtain 

Vsa = H0300 0 00-1] T 

30 The resulting General Network model is shown in Fig. 12b. It is noted that this results in a total of four 

connections of the bit lines to two EOR gates, one a two-input EOR gate, and the other a three input EOR 

gate. Further, two a k weighting values must be stored. 

Comparing the resulting General Network models for 0 = 0 and for 0 = 2,-2, it is seen that each results 

in different numbers of connections to the bit lines, different types of EOR gates and different numbers of 
35 a k weighting values to be stored. A system designer would be able to use this information to design a 

General Network model to optimize these parameters as needed or desired. 

As a further example, consider the feedback shift register (FSR) shown in Fig. 16. In Fig. 16, and 

subsequent Figs., the element labelled "T" indicates a delay element of one period of length T. Because 

the FSR is a feedback network, the feedback General Network model is chosen. The system has two 
40 different quiescent (or initial) states: x(n) and all memory states equal to "0", and x(n) and all memory 

states equal to "1". Thus, two cases are examined. 

The first case analyzed is for x(n) and all memory locations set at "0". In order to feed back v(n), delay 

must be introduced. From Fig. 15 it is realized that a three delay model is required. This results in a 

construction of the b-vector as 
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55 



which is rewritten as the following from the binary representation 
b(n) = [0 1 8 4 10 12 14 6 2 9 13 7 11 5 3 1] 
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with the resulting output 

v(n) = [0 1 0 1 1 1 0 0 1 1 0 1 000] 

It should be noted that b(n) contained one duplicated value, 1, which for the present solution can be ignored 
or the corresponding responses averaged to provide a single N(h) to b(n) = 1 (i.e., b does not take on the 
5 value of 15). This will result in an indefinite value, 0, in the 7 vector as shown below. 
7 = [0 1 1 0 1 0 0 1 0 1 1 0 1 0 0 0] T 

Turning to the second case, the initial conditions of the first case are complimented (i.e., x(n) and all 
memory locations are assumed to be "1 "). This results in the values of the b-vector 
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20 

which is rewritten as the following decimal valued integer vector from the binary representation 

b(n) * [15 14 7 11 53 1 9-13 6 2-8 4 10 12 14] 
with the resulting output 

v(n) = [1 010001 100101 11 0] 
25 Again, b(n) contained one duplicated value, 14, which for the present solution can be ignored or averaged 

as previously discussed, (i.e., b does not take on the value of 0). This will result in an indefinite value, © , in 

the 7 vector as shown below. 

7 - le 1 1 0 1 0 0 1 0 1 1 0 1 0 0 1] T 

Now, if the two cases are considered together to arrive at an "average" 7 vector the following is 
30 obtained 

7 = [0 1 1 0 1 0 0 1 0 1 1 0 1 0 0 1] T 

Using this "average" 7 vector yields, after the FWT and reordering 
k a = ^ a = ^[1 0 0 0 0 0 0 0 0 0 0 0 0 0 -1 0] T 
This results in the General Network model shown in Fig. 16. 
35 In the absence of an input signal (x(n) = 0) and if the initial state (content) of the delay elements were 
zero, this FSR would forever remain locked-up in this all-zero state. Similarly, if the input were to be x(n)- 
= 1, and all initial memory states set to unity, the FSR would remain locked-up in this state. The unused 
DOF represented by © may be used to overcome this feature. For example, if the first b vector with 7 (15) 
undetermined were to be used with 7 15) = 0 for calculation of the r a vector it would yield 

40 * a = TB « = TE [7 1 1 -1 1 -1 -1 1 1 -1 -1 1 -1 1 -7 -1] 

or 

T50r = 1/2 [10000000000000 -1 0] + |g[-+ + - + -- + + -- + .+ + .] 
where 

0i 1 1 1 (k) = [- + +- + --+ +-- + -+ + -] 
45 The added "hardware" implied by the term 

TB*llii(k) 

ensures that if the network ever falls into state b = 15, the network will revert to normal operation. Similarly, 

for the second set of complementary initial conditions, the assumption that 7(0) = 0 will yield 

iio = { B a = 1/2[10000000000000-1 0] + { B [ + + + + + + + + + + + + + + + +] 

50 ensuring that if the network falls into the "forbidden" state b = 0, the network will self initiate. 

It is important to realize that other choices for 7 (0) and (15) will yield other auxiliary characteristics. 
These other states may be used by the designer to optimize the parameters needed or desired. 

It is also important to realize that the present invention is not constrained by the type of input signal 
(i.e. f digital, analog, fixed point, floating point, logic, etc.). As an example, consider th network shown in 

55 Figure 18. This particular general network structure is a degenerate version of the type shown in Figure 14 
containing feed-forward and feed-back paths except that because the a and 0 coefficient vectors are the 
same, the output from the adders 52 and 56 are therefore equal to v(t). which is the same as feeding v(t) 
back into the WEX network through an appropriate delay element T. The purpose of this general network is 
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to accept a floating point sequence of numbers and produce a signed magnitude sum at the output, i.e., a 
floating point to fixed point signed magnitude accumulator. 

The upper 16 coefficients are used to convert the incoming floating point numbers to signed magnitude 
fixed point numbers. By generating appropriate sum and differences of these weights, provided that the 
5 weights are stored as fixed point signed magnitude numbers and provided that the summing junction is 
implemented as a signed magnitude adder with at least 1 1 bits on the output. (The 11 bit constraint on the 
accumulator was arbitrarily chosen for purposes of this example only.) The floating point input, x, is in 6-bit 
code, where 3 bits represent a mantissa, one bit represents a sign, and two bits represent an exponent. 
That is 

w x = (s)(xxx) # 4 eo + 2ey 
where 

s = sign bit = {? I 1 
e k = exponent bit = {? 
000 £ xxx £ 1 1 1 

75 Thus, if the 3-bit floating point number mantissa is interpreted as an integer, it ranges from 0 to 7 and 
when combined with the sign bit provides a range of +7 or - 1. The maximum value of the exponent is 3 so 
that the extreme range of numbers represented on input are + 488 or -448, which corresponds to 
approximately a 10-bit range (±512) using this 6-bit floating point format. 

The previously described methods for obtaining the coefficient vectors r a and A 0 may be used for 

20 synthesizing this network. 

The ability to do General Network operation on floating point numbers reduces the dimensions of the 
General Network due to the efficiency of representing numbers in floating point format. 

In general, to those skilled in the art to which this invention relates, many changes in construction and 
widely differing embodiments and applications of the present invention will suggest themselves without 

25 departing from its spirit and scope. For example, as has been noted, the Walsh functions are well suited to 
the present invention because of their ease of application in digital contexts. However, other basis sets of 
functions may also be used in the method and apparatus of the present invention with equivalent results. 
For example, the Walsh functions may be modified by transposing certain rows or columns to arrive at 
modified Walsh matrices. Though not identical to the Walsh matrices, these modified Walsh matrices may 

30 still yield correct results with modifications of the procedures outlined above. In fact, any orthogonal set of 
funtions may be utilized with normalization of the coefficients under proper conditions. Thus, the disclosures 
and descriptions herein are purely illustrative, and are not intended to be in any sense limiting. 



35 Claims 

1. A modeling cell for modeling the behavior of a reference network in response to a plurality of inputs, 
including: 

means for generating a plurality of vector elements each representative of a unique combination of said 
40 inputs; 

means for applying to each element a predetermined weighting coefficient, and; 
means for combining said weighted elements in a linear manner; 

said weighting coefficients being selected such that said combination yields the expected or desired output 
of said reference network in response to said inputs. 
45 2. A modeling cell as claimed in claim 1 and including: 
means for delaying an input in time and; 

means for applying said delayed input to the modeling cell as an additional input. 

3. A modeling cell as claimed in claim 1 and including means for receiving additional inputs, said 

additional inputs being derived from said vector elements, 
so 4. A method of modeling a network including a modeling cell as claimed in claim 1, including the steps 

of selected said weighting coefficients by observing the output of the reference model as a function of 

modeling cell input combinations and taking the inverse Walsh transform thereof. 

5. A method of modeling a network as claimed in claim 4, wherein said function is made up of 

respective averaged values of responses to each input combination. 
55 6. A modeling system including a modeling cell as claimed in claim 1, further comprising means for 

quantizing the input signal prior to calculation of the coefficient vector to produce an n-bit input signal in 

digital format. 

7. The modeling system including a modeling cell as claimed in claim 1, wherein the means for 
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calculating the coefficient vector comprises a fast Walsh transform network. 

8. The modeling system according to claim 7, wherein the means for selecting elements of the 
coefficient vector comprises a network capable of forming all possible combinations of the bits of the n-bit 
input signal, each combination corresponding to an element of the coefficient vector, and a network for 
performing the exclusive -or function on each combination, the output of the network for performing the 
exclusive -or function being a bistable signal which determines whether each individual element of the 
coefficient vector is to be selected. 

9. The modeling system including a modeling cell as claimed in claim 1 , wherein the means for forming 
the linear combination of the selected elements of the coefficient vector comprises a summing means. 

10. A modeling system for modeling the response of a system to a selected input signal, the input 
signal being an n-bit signal in digital format, the system having a response to the input signal which is 
known in terms of its actual value or in terms of its desired value, comprising: 

means for establishing a relationship between the input signal and the response of the system to the input 
signal; 

means for calculating a coefficient vector for a selected set of basis vectors from the relationship, the linear 
sum of which is capable of representing the relationship; 

means for calculating the sign of each element of the coefficient vector from the input signal; and 

means for forming the linear combination of the elements of the coefficient vector, each element having its 

sign determined by the means for calculating the sign of each element of the coefficient vector. 

11. The modeling system according to claim 10, further comprising means for quantizing the input 
signal prior to calculation of the coefficient vector to produce an n-bit input signal in digital format. 

12. The modeling system according to claim 10, wherein the means for calculating the coefficient 
vector comprises a fast Walsh transform network. 

13. The modeling system according to claim 12, wherein the means for calculating the signs of each 
element of the coefficient vector comprises a network capable of forming all possible combinations of the 
bits of the n-bit input signal, each combination corresponding to an element of the coefficient vector, and a 
network for performing the exclusive-or function on each combination, the output of the network for 
performing the exclusive-or function being a bistable signal which determines the sign of each element of 
the coefficient vector. 

14. The modeling system according to claim 10, wherein the means for forming the linear combination 
of the elements of the coefficient vector comprises a summing means. 

15. A modeling system for modeling the feedback and feedforward response which makes up the 
response of a system to a selected input signal, the input signal being an n-bit signal in digital format, the 
system having a response to the input signal which is known in terms of its actual value or in terms of its 
desired value, comprising: 

means for establishing a relationship between the input signal and the response of the system to the input 
signal; 

means for calculating a first coefficient vector for a selected set of basis vectors from the relationship, the 
linear sum of which is capable of representing the feedback response of the system; 
means for calculating the sign of each element of the first coefficient vector from the input signal; 
means for forming the linear combination of the elements of the first coefficient vector, each element having 
its sign determined by the means for calculating the sign of each element of the first coefficient vector; 
means for calculating a second coefficient vector for a selected set of basis vectors from the relationship 
and from the linear combination of the elements of the first coefficient vector, the linear sum of which is 
capable of representing the feedforward response of the system; 

means for calculating the sign of each element of the second coefficient vector from the input signal and 
from the linear combination of the elements of the first coefficient vector; and 

means for forming the linear combination of the elements of the second coefficient vector, each element 
having its sign determined by the means for calculating the sign of each element of the second coefficient. 

16. A modeling system for modeling the response of a system to a selected input signal, the input 
signal being an n-bit signal in digital format, the system having a unique response to the input signal which 
is known in terms of its actual value or in terms of its desired value, comprising: 

a decoder network adapted to receive the input signal, for forming, as its output, all possible unique 
combinations of the bits of the n-bit input signal; 

an exclusive-or network, comprising a plurality of exclusive-or gates, each corresponding to an individual 
combination of the bits of the n-bit input signal, adapted to receive the output signals of the decoder 
network and capable of generating a plurality of bistable signals, each bistable signal corresponding to an 
individual combination of the bits of the n-bit input signal, as its output, the value of each bistable signal 
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determined by an exclusive-or relationship between the bits in each combination; 

a coefficient storage means for storing therein the coefficients of the Walsh transform of the known 
response of the system to the selected input signal, each coefficient corresponding to an individual 
combination of the bits of the n-bit input signal, and adapted to receive th bistable output signals of the 

5 exclusive-or network such that a first bistable signal corresponding to a first combination of bits causes the 
coefficient corresponding to the first combination of bits to be output by the coefficient storage means, 
while a second bistable signal corresponding to the first combination of bits causes the negative of the 
coefficient corresponding to the first combination of bits to be output by the coefficient storage means; and 
a linear combining means for forming, as its output, a linear combination of the outputs of the coefficient 

w storage means, the output modeling the response of the system to the selected input signal. 

17. A modeling system for modeling the feedback and feedforward responses which make up the 
response of a system to a selected input signal, the input signal being an n-bit signal in digital format, the 
system having a unique response to the input signal which is known in terms of its actual value or in terms 
of its desired value, comprising: 

/5 a decoder network adapted to receive as input signals the input signal and the feedback response, for 
forming, as its output, all possible unique combinations of the bits of the n-bit input signal; 
an exciusive-or network, comprising a plurality of exclusive-or gates, each corresponding to an individual 
combination of the bits of the n-bit input signal, adapted to receive the output signals of the decoder 
network and capable of generating a plurality of bistable signals, each bistable signal corresponding to an 

20 individual combination of the bits of the n-bit input signal, as its output, the value of each bistable signal 
determined by an exciusive-or relationship between the bits in each combination; 

a first coefficient storage means for storing therein the coefficients of the Walsh transform of the known 
feedback response of the system to the selected input signal, each coefficient corresponding to an 
individual combination of the bits of the n-bit input signal, and adapted to receive the bistable output signals 

25 of the exclusive-or network such that a first bistable signal corresponding to a first combination of bits 
causes the coefficient corresponding to the first combination of bits to be output by the coefficient storage 
means, while a second bistable signal corresponding to the first combination of bits causes the negative of 
the coefficient corresponding to the first combination of bits to be output by the coefficient storage means; 
a first linear combining means for forming, as its output, a linear combination of the outputs of the first 

30 coefficient storage means, the output modeling the feedback response of the system to the selected input 
signal; 

a second coefficient storage means for storing therein the coefficients of the Walsh transform of the known 
feedforward response of the system to the selected input signal, each coefficient corresponding to an 
individual combination of the bits of the n-bit input signal, and adapted to receive the bistable output signals 

35 of the exclusive-or network such that a first bistable signal corresponding to a first combination of bits 
causes the coefficient corresponding to the first combination of bits to be output by the coefficient storage 
means, while a second bistable signal corresponding to the first combination of bits causes the negative of 
the coefficient corresponding to the first combination of bits to be output by the coefficient storage means; 
a second linear combining means for forming, as its output, a linear combination of the outputs of the 

40 second coefficient storage means, the output modeling the feedforward response of the system - to the 
selected input signal. 

18. A modeling system for modeling the response of a system to a selected system input signal, the 
system having a unique response to the system input signal which is known in terms of its actual value or 
in terms of its desired value, comprising: 

45 means for quantizing the system input signal to produce an n-bit input signal in digital format; 

a decoder network adapted to receive the input signal, for forming, as its output, all possible unique 
combinations of the bits of the n-bit input signal; 

an exclusive-or network, comprising a plurality of exclusive-or gates, each corresponding to an individual 
combination of the bits of the n-bit input signal, adapted to receive the output signals of the decoder 
so network and capable of generating a plurality of bistable signals, each bistable signal corresponding to an 
individual combination of the bits of the n-bit input signal, as its output, the value of each bistable signal 
determined by an exclusive-or relationship between the bits in each combination; 

a coefficient storage means for storing therein the coefficients of the Walsh transform of the known 
response of the system to the selected input signal, each coefficient corresponding to an individual 
55 combination of the bits of the n-bit input signal, and adapted to receive the bistable output signals of the 
exclusive-or network such that a first bistable signal corresponding to a first combination of bits causes the 
coefficient corresponding to the first combination of bits to be output by the coefficient storage means, 
whil a s cond bistable signal corresponding to the first combination of bits causes the negative of the 
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coefficient corresponding to the first combination of bits to be output by the coefficient storage means; and 
a summing means for forming, as its output, a sum of the outputs of the coefficient storage means, the 
output modeling the response of the system to the selected input signal. 

19. A modeling system for modeling the feedback and feedforward responses which make up the 
response of a system to a selected system input signal, the system having a unique response to the 
system input signal which is known in terms of its actual value or in terms of its desired value, comprising- 
means for quantizing the system input signal to produce an n-bit input signal in digital format; 
a decoder network adapted to receive as input signals the input signal and the feedback response, for 
forming, as its output, all possible unique combinations of the bits of the n-bit input signal; 
an exclusive-or network, comprising a plurality of exclusive-or gates, each corresponding to an individual 
combination of the bits of the n-bit input signal, adapted to receive the output signals of the decoder 
network and capable of generating a plurality of bistable signals, each bistable signal corresponding to an 
individual combination of the bits of the n-bit input signal, as its output, the value of each bistable signal 
determined by an exclusive-or relationship between the bits in each combination; 

a first coefficient storage means for storing therein the coefficients of the Walsh transform of the known 
feedback response of the system to the selected input signal, each coefficient corresponding to an 
individual combination of the bits of the n-bit input signal, and adapted to receive the bistable output signals 
of the exclusive-or network such that a first bistable signal corresponding to a first combination of bits 
causes the coefficient corresponding to the first combination of bits to be output by the coefficient storage 
means, while a second bistable signal corresponding to the first combination of bits causes the negative of 
the coefficient corresponding to the first combination of bits to be output by the coefficient storage means- 
a first summing means for forming, as its output, a sum of the outputs of the first coefficient storage means, 
the output modeling the feedback response of the system to the selected input signal; 
a second coefficient storage means for storing therein the coefficients of the Walsh transform of the known 
feedforward response of the system to the selected input signal, each coefficient corresponding to an 
individual combination of the bits of the n-bit input signal, and adapted to receive the bistable output signals 
of the exclusive-or network such that a first bistable signal corresponding to a first combination of bits 
causes the coefficient corresponding to the first combination of bits to be output by the coefficient storage 
means, while a second bistable signal corresponding to the first combination of bits causes the negative of 
the coefficient corresponding to the first combination of bits to be output by the coefficient storage means- 
a second summing means for forming, as its output, a sum of the outputs of the second coefficient storage 
means, the output modeling the feedforward response of the system to the selected input signal. 

20. A method for modeling the response of a system to a selected system input signal, the system 
having a response to the system input signal which is known in terms of its actual value or in terms of its 
desired value, comprising the steps of: 

quantizing the system input signal to form an n-bit input signal in digital format; 
forming all possible combinations of the bits of the n-bit input signal; 

calculating coefficients corresponding to each combination of bits such that the response of the system to 
the input signal may be represented by a linear combination of the coefficients; 

generating a bistable signal corresponding to each coefficient, the bistable signal determining the sign of 
the coefficient; and 

forming the linear combination of the coefficients which represents the modeled response of the system to 
the selected input. 

21. A method for modeling the response of a system to a selected input signal, the input signal being 
an n-b.t signal in digital format, the system having a response to the input signal which is known in terms of 
its actual value or in terms of its desired value, comprising the steps of: 

forming all possible combinations of the bits of the n-bit input signal; 

calculating coefficients corresponding to each combination of bits such that the response of the system to 
the input signal may be represented by a linear combination of the coefficients; 

generating a bistable signal corresponding to each coefficient, the bistable signal determining the siqn of 
the coefficient; and 

forming the linear combination of the coefficients which represents the modeled response of the system to 
the selected input. 

22. A method for modeling the response of a system to a selected input signal, the input signal being 
an n-bit signal in digital format, the system having a unique response to the input signal which is known in 
terms of its actual value or in terms of its desired value, comprising the steps of: 

forming all possible combinations of the bits of the n-bit input signal; 

calculating coefficients corresponding to each combination of bits such that the response of the system to 
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the input signal may be represented by a linear combination of the coefficients; 

performing an exc!usive-or operation on each of the combinations of bits, each exclusive-or operation 
producing a bistable signal corresponding to each coefficient, the bistable signal determining the sign of the 
coefficient; and 

5 forming the linear combination of the coefficients which represents the modeled response of the system to 
the selected input. 

23. A method for modeling the response of a system to a selected input signal, the input signal being 
an n-bit signal in digital format, the system having a unique response to the input signal which is known in 
terms of its actual value or in terms of its desired value, comprising the steps of: 

10 forming all possible combinations of the bits of the n-bit input signal; 

calculating coefficients corresponding to each combination of bits from a fast Walsh transform of the known 
response of the system to the input signal such that the response of the system to the input signal may be 
represented by a linear combination of the coefficients; 

performing an exclusive-or operation on each of the combinations of bits, each exclusive-or operation 
75 producing a bistable signal corresponding to each coefficient, the bistable signal determining the sign of the 
coefficient; and 

forming the linear combination of the coefficients which represents the modeled response of the system to 
the selected input. 

24. A method for modeling the feedback and feedforward responses which make up the response of a 
20 system to a selected system input signal, the system having a unique response to the system input signal 

which is known in terms of its actual value or in terms of its desired value, comprising the steps of: 
quantizing the system input signal to form an n-bit input signal in digital format; 
forming all possible combinations of the bits of the n-bit input signal; 

calculating a first set of coefficients corresponding to each combination of bits such that the feedback 
25 response of the system to the input signal may be represented by a linear combination of the elements of 
the first set of coefficients; 

generating a bistable signal corresponding to each of the elements of the first set of coefficients, th 
bistable signal determining the sign of each of the elements of the first set of coefficients; 
forming a linear combination of the elements of the first set of coefficients which represents the feedback 
30 response of the system to the selected input; 

calculating a second set of coefficients corresponding to each combination of bits such that the response of 
the system to the input signal may be represented by a linear combination of the elements of the second 
set of coefficients; 

generating a bistable signal corresponding to each of the elements of the second set of coefficients, the 
35 bistable signal determining the sign of each of the elements of the second set of coefficients; and 

forming a linear combination of the elements of the second set of coefficients which represents the 
response of the system to the selected input. 

25. A method for modeling the feedback and feedforward responses which make up the response of a 
system to a selected input signal, the input signal being an n-bit signal in digital format, the system having 

40 a unique response to the input signal which is known in terms of its actual value or in terms of its desired 
value, comprising the steps of: 

forming ail possible combinations of the bits of the n-bit input signal; 

calculating a first set of coefficients corresponding to each combination of bits such that the feedback 

response of the system to the input signal may be represented by a linear combination of the elements of 
45 the first set of coefficients; 

generating a bistable signal corresponding to each of the elements of the first set of coefficients, th 

bistable signal determining the sign of each of the elements of the first set of coefficients; 

forming a linear combination of the elements of the first set of coefficients which represents the feedback 

response of the system to the selected input; 
so calculating a second set of coefficients corresponding to each combination of bits such that the response of 

the system to the input signal may be represented by a linear combination of the elements of the second 

set of coefficients; 

generating a bistable signal corresponding to each of the elements of the second set of coefficients, the 
bistable signal determining the sign of each of the elements of the second set of coefficients; and 
55 forming a linear combination of the elements of the second set of coefficients which represents the 
response of the system to the selected input. 

26. A method for modeling the feedback and feedforward responses which make up the response of a 
system to a selected input signal, the input signal being an n-bit signal in digital format, the system having 
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a unique response to the input signal which is known in terms of its actual value or in terms of its desired 
value, comprising the steps of: 

forming all possible combinations of the bits of the n-bit input signal; 

calculating a first set of coefficients corresponding to each combination of bits such that the feedback 
response of the system to the input signal may be represented by a linear combination of the elements of 
the first set of coefficients; 

performing an exclusive-or operation on each of the combinations of bits, each exclusive-or operation 
producing a bistable signal corresponding to each element of the first set of coefficients, the bistable signal 
determining the sign of each coefficient; 

forming a linear combination of the elements of the first set of coefficients which represents the feedback 
response of the system to the selected input; 

calculating a second set of coefficients corresponding to each combination of bits such that the response of 
the system to the input signal may be represented by a linear combination of the elements of the second 
set of coefficients; 

performing an exclusive-or operation on each of the combinations of bits, each exclusive-or operation 
producing a bistable signal corresponding to each element of the second set of coefficients, the bistable 
signal determining the sign of each coefficient; and 

forming a linear combination of the elements of the second set of coefficients which represents the 
response of the system to the selected input. 

27. A method for modeling the feedback and feedforward responses which make up the response of a 
system to a selected input signal, the input signal being an n-bit signal in digital format the system having 
a unique generl response to the input signal which is known in terms of its actual value or in terms of its 
desired value, comprising the steps of: 

forming ail possible combinations of the bits of the n-bit input signal; 

calculating a first set of coefficients corresponding to each combination of bits from a fast Walsh transform 
of the known response of the system to the input signal such that the feedback response of the system to 
the input signal may be represented by a linear combination of the first set of coefficients; 
performing an exclusive-or operation on each of the combinations of bits, each exclusive-or operation 
producing a bistable signal corresponding to each element of the first set of coefficients, the bistable signal' 
determining the sign of each coefficient; 

forming a linear combination of the elements of the first set of coefficients which represents the feedback 
response of the system to the selected input- 
calculating a second set of coefficients corresponding to each combination of bits from a fast Walsh 
transform of the known response of the system to the input signal such that the response of the system to 
the input signal may be represented by a linear combination of the elements of the second set of 
coefficients; 

performing an exclusive-or operation on each of the combinations of bits, each exclusive-or operation 
producing a bistable signal corresponding to each element of the second set of coefficients, the bistable 
signal determining the sign of each coefficient; and 

forming a linear combination of the elements of the second set of coefficients which represents the 
response of the system to the selected input. 
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© General network modeling and synthesis. 



© A method and apparatus for modeling and syn- 
thesizing the response of a network to selected input 
signals where the input signals may be multi-channel 
in analog or digital form, and where the networks 
response may be linear or non-linear and depend on 
the present input signals as well as its past re- 
sponses. A relationship is established between the 
input signals and the network's response to the input 
signals. Basis vectors are selected capable of repre- 



senting the relationship. Weighting values for each 
basis vector are calculated. The calculated weighting 
values are applied to the corresponding basis vec- 
tors to form weighted basis vectors. The synthesis 
and modeling are then performed by forming a linear 
combination of the weighted basis vectors. Provision 
is made for feeding back the linear combination to 
account for memory and other history-dependent 
responses of the network. 
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